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Abstract: Weighted automata model quantitative aspects of systems like the con- 
| sumption of resources during executions. Traditionally, the weights are assumed 

to form the algebraic structure of a semiring, but recently also other weight com- 
putations like average have been considered. Here, we investigate quantitative 
context-free languages over very general weight structures incorporating all semi- 
rings, average computations, lattices, and more. In our main result, we derive the 
pL^ ■ fundamental Chomsky-Schiitzenberger theorem for such quantitative context-free 

languages, showing that each arises as the image of a Dyck language and a reg- 
ular language under a suitable morphism. Moreover, we show that quantitative 
context-free language are expressively equivalent to a model of weighted pushdown 
automata. This generalizes results previously known only for semirings. We also 
{SJ | investigate when quantitative context-free languages assume only finitely many val- 

ues. 

ov 
co 

^ '■ 1 Introduction 
<N 

The Chomsky-Schiitzenberger Theorem forms a famous cornerstone in the theory of context- 
free languages [TU] relating arbitrary context-free languages to Dyck-languages and regular 
languages. A weighted version of this result was presented in |23j where the weights are taken 
from a commutative semiring. For surveys on this we refer the reader to [H 122] . 

Recently, in El E] new models of quantitative automata for technical systems have been 
investigated describing, e.g., the average consumption of resources. In [9] pushdown automata 
with mean-payoff cost functions were considered which comprize a quantitative modelling of 
sequential programs with recursion. These cost functions cannot be computed in semirings. Au- 
tomata over the general algebraic structure of valuation monoids incorporating both semiring- 
weighted automata and quantitative automata were investigated in [T2"l [T3], 

It is the goal of this paper to investigate weighted context-free grammars over valuation 
monoids. These include all semirings but we may also associate to each derivation, for in- 
stance, the average of the costs of the involved productions. We could also associate with each 
production its degree of sharpness or truth, as in multi-valued logics, using bounded lattices 
as valuation monoids. Thereby, we can associate to each word over the underlying alphabet 
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S such a value (real number, element of a lattice, etc.) indicating its total cost or degree of 
truth, and any function from X* into the value set is called a quantitative language or series. 
Note that by the usual identification of sets with {0,1} -valued functions, classical languages 
arise as particular quantitative languages. 

Now we give a summary of our results. We prove the equivalence of weighted context-free 
grammars and weighted pushdown automata over arbitrary valuation monoids (cf. Theorem 
15. ip . In our main result we derive a weighted version of the Chomsky-Schutzenberger Theorem 
over arbitrary valuation monoids (cf. Theorem 16 . X [) . In particular, we show that any quan- 
titative context-free language arises as the image of a Dyck-language and a regular language 
under a suitable weighted morphism. Conversely, each quantitative language arising as such 
an image is a quantitative context-free language. This shows that the weighted Chomsky- 
Schiitzenberger Theorem holds for much more general weighted structures than semirings, in 
particular, neither associativity, nor commutativity, nor distributivity of the multiplication are 
needed. The classical Chomsky-Schutzenberger Theorem follows by considering the Boolean 
semiring {0, 1}. 

Finally we consider series which assume only finitely many values. Such series were important 
in the context of recognizable series and weighted MSO logic (cf. OUT]). In contrast to the 
setting of recognizable series, even over the semiring of natural numbers, characteristic series of 
inherently ambiguous context-free languages are not context-free (cf . Observation 17. 1|) . Here 
we give sufficient conditions for obtaining context-freeness. Conversely, we show that under 
suitable local finiteness conditions on the valuation monoid, each quantitative context-free 
language assumes just finitely many values, each on context-free languages, only. These results 
seem to be new even for finite semirings. As a consequence, weighted context-free languages 
over bounded lattices are context-free step functions. 

In \13\ [2"H [T2] , two other fundamental results of formal language theory, the Kleene and Biichi 
theorem for regular languages, were shown to hold not only for semiring-weighted automata 
[24\ I14j. but also for quantitative automata over valuation monoids. This raises the question 
which further results from the theory of semiring-weighted automata could be extended to 
more general quantitative automata settings including calculations of averages. 

2 Valuation Monoids and Series 

A unital valuation monoid is a tuple (K, +, val, 0, 1) such that 

1. (K, + ,0) is a commutative monoid, 

2. val : K* — > is a mapping such that val(a) = a for each a € K and val(e) = 1, 

3. val(ai, . . . , a n ) = whenever a« = for some 1 < i < n, and 

4. val(ai, . . . ,Oi_i, l,a i+ i, . . . ,a n ) = val(ai, . . . , Oi_i, Oi+i, . . . ,a n ) for any 1 < i < n. 

The concept of valuation monoid was introduced in |12| 113] as a structure (K, +, val, 0) with 
a mapping val : K + K satisfying requirements 1-3 correspondingly. In [12^ [T3] 121] . also 
many examples of valuation monoids were given. For this paper, it will be important that 
the valuation monoids contain a unit 1. We will see below in Example 12. II that this means no 
restriction of generality. Note that, similarly to sums where the element is neutral and can 
be left out, val can be considered as a very general product in which the unit 1 is neutral as 
reflected by requirement 4. 
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Example 2.1. 1. Let (K, +, val, 0) be a valuation monoid and let 1 £ K. We put K' = KL){1} 
and define (K' , +', val', 0, 1) such that +' extends +, x +' 1 = 1 +' x = 1 for each x £ if', and 
val'(ai, . . . , a n ) = val(6i, . . . , b m ) where h\ . . . b m is the subsequence of ai, . . . , a n excluding l's. 
Then [K 1 , +', val , 0, 1) is a unital valuation monoid. 

2. The structure (RU {— oo}, sup, avg, — oo) with avg(ai, . . . , a n ) = - • Y^=i a « ^ s a valu- 
ation monoid. Applying the procedure of Example 1 to it, we could add oo as the unit 
1, disregarding oo when calculating averages. This leads to a unital valuation monoid 
(R U {— oo, oo}, sup, avg, — oo, oo). 

3. Let (K, +, val, 0) be a valuation monoid. Note that in Example 1, the unit 1 satisfies 
1 +' 1 = 1. Here we wish to give another extension of K to a unital valuation monoid K' which 
does not satisfy this law for 1. Let K 1 = N x K with componentwise addition +'. Given 
(m 1 ,xi),. . . ,(m n ,x n ) we define val' ((mi, xi), (m n , x n )) = val(xi, . . . , x\, . . . , x n . . . , x n ) 
where this sequence contains mi copies of Xi, if mi ^ and x% ^ (for 1 < i < n), otherwise 
the XiS are excluded from the sequence to which val is applied. Then (if', +', val', (0, 0), (1,0)) 
is a unital valuation monoid. 

4. Next we introduce unital valuation monoids where the valuation arises from 'local', binary 
operations as follows. First, we define a unital monoid-magma to be a tuple (K, +,-,0,1) 
such that (K,+,0) is a commutative monoid, • : K x K — > K is a binary operation, and 
a ■ = • a = and a ■ 1 = 1 • a = a for every a £ K. Then we can consider each unital 
monoid-magna (K, +,-,0,1) as the particular unital valuation monoid (K, +, val, 0, 1) where 
val(ai, . . . , a n ) = (• • • ((ai ■ 02) • 03) ••••)• a n . Now we list some examples of (classes of) unital 
monoid-magmas which can be viewed as unital valuation monoids in this way: 

• A unital monoid-magma is a strong bimonoid, if the multiplication is associative, and 
a semiring, if the multiplication is associative and distributive (from both sides) over 
addition. For a range of examples of strong bimonoids which are not semirings we refer 
the reader to [T4"] . 

• The Boolean semiring B = ({0, 1}, V, A, 0, 1) allows us to give exact translations between 
unweighted and B-weighted settings. The semiring (N, +, •, 0, 1) of natural numbers per- 
mits counting. 

• Each bounded lattice (L, V, A, 0, 1) (i.e. < x < 1 for each x G L) is a strong bimonoid. 
There is a wealth of lattices [H [18] which are not distributive, hence strong bimonoids 
but not semirings. 

• Let (5, +, ■, 0, 1) be a strong bimonoid and let n > 2. Then the set of all (n x n)-matrices 
over S together with the usual pointwise addition and the usual multiplication of matrices 
forms a unital monoid-magma. We note that this matrix multiplication is not associative 
if the multiplication of the strong bimonoid is not distributive. We just note that such 
matrices arise naturally when considering the behavior of weighted automata over strong 
bimonoids, cf. [TH p. 159]. 

• The structure (R, sup, avg 2 , — 00, 00) with R = RU {—00,00}, and avg 2 (a,&) = g ^ if 
a,b < 00, avg 2 (a,oo) = avg 2 (oo,a) = a (a, b € R) is a unital monoid-magma, but not a 
strong bimonoid. 
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The importance of infinitary sum operations was observed early on in weighted automata 
theory, cf. |16j . In our context, they will arise for ambiguous context-free grammars if a given 
word has infinitely many derivations. 

A monoid (K, +, 0) is complete [16] if it has infinitary sum operations : K 1 — > K for any 
index set I such that Y^ie% a i = °' ^2ie{k} a i = a k> Y^ie{j,k} ai = a i + ak ^ or 3 ^ ^' and 
Ej G J (Eie/j «i) = Eie/ °* if Uje j ^ = * and Ij n J fc = for j / fc. 

A monoid (if, +, 0) is idempotent if a + a = a for each a G if , and a complete monoid is 
completely idempotent if a = a for each a £ K and any index set I. 

We call a unital valuation monoid (if, +, val, 0, 1) complete, idempotent, or completely idem- 
potent if (if, +, 0) has the respective property. 

Example 2.2. 1. The Boolean semiring B and the tropical semiring (NU{oo}, min, +, oo, 0) are 
complete and completely idempotent. For a wealth of further examples of complete semirings 
see [13 Ch.22]. 

2. The unital valuation monoid (R U {— oo, oo}, sup, avg, — oo, oo) (cf. Example 12.1( 2)) is 
complete and completely idempotent. 

3. Consider the commutative monoid ({0, 1, oo}, +, 0) with 1 + 1 = 1, l + oo = oo + oo = oo, 
and Yli 1 = oo for any infinite index set I and corresponding natural laws for infinite sums 
involving the other elements. This monoid is complete and idempotent, but not completely 
idempotent. 

Let £ be an alphabet and if a unital valuation monoid. A series or quantitative language over 
£ and if is a mapping s : £* — > if. As usual, we denote s(w) by (s,w). The support of s is 
the set supp(s) = {w G £* | (s,w) ^ 0}. The image of s is the set im(s) = {(s, w) \ w G £*}. 
The classes of all series over £ and if is denoted by if ((£*))■ 

Let s,s' € if ({£*)) be series. We define the sum s + s' by letting (s + s',w) = (s,u>) + (s',w) 
for each u; G £*. 

A family of series (sj | i G I) is locally finite if for each it; G £* the set /„, = {i G I | (sj, to) ^ 0} 
is finite. In this case or if if is complete, we define Yliel Si e ^"((^*)) by letting (X^e/ s «> w ) = 
E^/J 5 ^) for ever y ™ e s *- 

For L C £*, we define the characteristic series 1l G if ((£*)) by (1l,w;) = 1 if u; G L, and 
(1l,w) = otherwise for u; G £*. 

In i/ie resi o/ i/iis paper, let (if, +, val, 0, 1) denote an arbitrary unital valuation 
monoid, unless specified otherwise. 

3 Weighted Context-Free Grammars 

In this section, we introduce our notion of weighted context-free grammars and we present basic 
properties. First we fix our notations for context-free grammars. Let £ be an alphabet. A 
context-free grammar (CFG) is a tuple Q = (N, £, Z, P) where N is a finite set (nonterminals), 
Z G N (initial nonterminal), and P N x (N U £)* a finite set (productions). 

The leftmost derivation relation of Q is the binary relation on the set (N U £)* of sentential 
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forms defined as follows. For every production p = (A — > £) G P we define the binary relation 

A (iVuX)* x (iVUX)* 
such that for every w G X* and ( G (N U X)*, we have 

wA(A w£C . 

The (leftmost) derivation relation of Q is the binary relation =>= Upgp 

A derivation of £7 is a sequence d = p\ . . . p n of productions Pi £ P such that there are sentential 
forms £o> ■ ■ ■ >£n with =£■ £j for every 1 < i < n. We abbreviate this derivation by £o =^ £n- 
Let 4 G JV and u> G X*. An A-derivation of w is a derivation d such that 4 4 w. We let 
D(A,w) denote the set of all ^-derivations of w. And we let D(w) = D(Z,w) denote the set 
of all derivations of w. 

The language generated by Q is the set 

L{Q) = {w£S* D(w) + 0} . 

We say that Q is ambiguous if there is a w G -^(£7) such that > 2; otherwise Q is 

unambiguous. A context-free language L is inherently ambiguous if every CFG Q with L = L(Q) 
is ambiguous. 

Due to the context-freeness of the rewriting we can observe the following easy decomposition 
of derivations. 

Observation 3.1. Let A G N , w G £*, and d = p\ . . . p n G w). Moreover, let 1 < i < n 
and pi = (B — > uqB\U\ . . . BkUk)- Then there are uniquely determined 

• fi,«2 € S* and 61,62 G P* and 

• wi, . . . , w k G X* and di G Z)(5i,u>i), ... ,d k e D(B k ,w k ) 
such that 

• W = V\ UqW\U\ . . . w k u k V2, 

• d = 6*i pid\ . . . d k 62, and 

• p i d 1 ...,d k e D(B, uqvjiUx . . . w k u k ). 

Next let K be a unital valuation monoid. A context-free grammar with weights is a tuple 
Q = (N, X, Z, P, wt) where (N,T,, Z, P) is a CFG and wt : P — > -ftT is a mapping (weight 
assignment). We say that Q is unambiguous if the underlying CFG is unambiguous. 

The weight of a derivation d = p\ . . . p n is the element in if defined by 

wt(d) = val(wt(pi), . . . ,wt(p n )) . 

We say that Q is a weighted context-free grammar (WCFG) if D(w) is finite for every w G X* 
or if K is complete. In this case we define the quantitative language of Q to be the series 
\Q\ G K{{T,*)) given for every w G X* by 

(||C7|M= E wt ( J ) • 
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Note that this sum exists by our assumptions on a WCFG. A series s G K" ((£*)) is a quantitative 
context-free language if there is a WCFG Q such that s = \Q\. The class of all quantitative 
context-free languages over E and K is denoted by CF(E, K). Moreover, we let uCF(E, A) 
comprise all series \Q\ where Q is an unambiguous WCFG. We say that two WCFG are equiv- 
alent, if they have the same quantitative language. 

Clearly, any CFG Q can be transformed into a WCFG over the Boolean semiring B by adding 
the weight assignment wt : P — > B such that wt(p) = 1 for each p G P. Then for each w G E* 
we have w G L(Q) if and only if (||£7||,tu) = 1, i.e., \\Q\\ = Consequently, a language L 

is context-free if and only if 1^ G CF(E,B). This shows that WCFG form a generalization of 
CFG. 

We say that a CFG Q = (A, E, Z, P, wt) with weights is proper if the right-hand side of each 
rule is an element of (N U E) + \ A (cf. |20t p. 302]), i.e., Q contains neither chain productions 
A — > B nor e-productions A — > e. Then obviously the set D[w) is finite for every w G E*. 

Observation 3.2. proper CFG with weights is a WCFG. 

A WCFG Q is in /lead normal form if every production has the form 

A -)■ x^i . . . -B fc 
where x G E U {e}, k>0, and A, B>i, . . . , B k G N. 

Lemma 3.3. For every (unambiguous) WCFG there is an equivalent (unambiguous) WCFG 
in head normal form. 

Proof. Let Q = (N, E, Z, P, wt) be a WCFG. We construct the CFG with weights Q' = 
(N',T,,Z,P',wt') such that 

• AT' = AT □{A, |<reE}, 

• P' and wt' are determined as follows. 

— If A — > e is in P, then A — > e is in P'\ moreover, wt'(A —} e) = wt(A — > e). 

— If A A^ in P with A G N U E and f G (A U £)*, then A -> A^' is in P' where 
^' is obtained from £ by replacing every a G E by j4 ct ; moreover, wt'(^4 — >• A^') = 
wt(A -> A^). 

— For every <r G E, the production A a — > a is in P'; moreover, wt'(vl CT — > cr) = 1. 

Then, for every w £ S*, we have that every derivation d of w by corresponds naturally to 
a uniquely determined derivation of w by and vice versa. Thus Q' is also a WCFG and 
corresponding successful derivations have the same weight. Thus = \Q'\. Clearly, Q is 
unambiguous if and only if Q' is unambiguous. □ 

Example 3.4. We consider the set of all arithmetic expressions over addition, multiplication, 
and the variable x. Assuming that the calculation of the addition (and multiplication) of two 
values needs n G N (resp., m G N) machine clock cycles, we might wish to know the average 
number of clock cycles it needs to calculate any of the operations occuring in an expression. 
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For this we consider the unital valuation monoid (MU{— oo, oo}, sup, avg, —00, 00) as in Example 
12.1( 2) and the WCFG Q = (N,T>, E, P) with the following set of productions and associated 
values: 

pi : E 4 E + E p 2 : E ™ E*E 
p 3 : E A (E) p 4 : E -4 x . 

For the expression w = x*x + x*x, the set of derivations is D(w) = {d} with d = p\d'd' and 
d! = p2PiPi- In fact, Q is unambiguous. Then 

/ 11 s-i n\/\/ \ / \ I ^ * Tift* 

(\Q\,w) = wt(a) = val(n, m, 1, 1, m, 1, 1) = avg(n, m, m) = . 

d' d> 



4 Weighted Pushdown Automata 

In this section, we introduce our notion of weighted pushdown automata, and we derive a few 
basic properties. First let us fix our notation for pushdown automata. Let £ be an alphabet. 
A pushdown automaton (PDA) over X is a tuple Ai = (Q, T, qo, 70, F, T) where Q is a finite set 
(states), r is an alphabet (pushdown symbols), qo € Q (initial state), 70 G T (initial pushdown 
symbol), F C Q (final states), and 

T C f Q x (S U {e}) x T x Q x F*, 

a finite set (transitions). Let (q, x, j,p, it) be a transition. We call q, x, and p its source state, 
label, and target state, respectively. 

The computation relation of M. is the binary relation on the set Q x S* x T* of configurations 
defined as follows. For every transition r = (q,x,j,p,ir) G T we define the binary relation 

h C (Q x £* x r*) x (Q x S* x r*) 
such that for every w G X* and /1 6 T*, we have 

r 

(q,xw,jfi) b (p,w,nn) . 

T 

The computation relation of M. is the binary relation b = IJreT 

A computation is a sequence = ri . . . r n of transitions Tj such that there are configurations 

Co, . . . , c n with Cj_i b Cj for every 1 < i < n. We abbreviate this computation by cq b c n . The 
ZabeZ of a computation n . . . r n is the sequence of labels of the involved transitions. Let w £ £* 

and q £ Q. A q-computation on w is a computation # such that (<?, 10,70) b (p, e,e) for some 
p G F. We let Q(q,w) denote the set of all ^-computations on it;, and we let O(iy) = 0(go ; u ; )- 
Moreover, we let Q = U«;gE* @( w )- 
The language recognized by M. is the set 

L(M) = {w G S* I 0(V) ^ 0} . 

That means, we consider acceptance of words by final state and empty pushdown. 
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Observation 4.1. Let (q, v, 71 . . . 7*.) h (p,e,e) be a computation. Put po = q. Then for 

i = 1, . . . , k we obtain successively a uniquely determined shortest computation rji, state pi G Q, 

m 

and word V{ G S* such that (pi-i,^, 7») h (pi,£, e) and n = r]i . . . v = v\ . . . Vk, and pk = p. 

Let M. be any PDA. We say that M. is ambiguous if there is a w G L(.M) such that > 2; 

otherwise A4 is unambiguous. 

Next let if be a unital valuation monoid. A pushdown automaton with weights in K is a tuple 
.M = (Q, T, qo, 70, -F, T, wt) where (Q,T,qo,^o,F,T) is a PDA and wt : T — > if is a mapping 
(weight assignment). We say that .A4 is unambiguous if the underlying PDA is unambiguous. 

The weight of a computation = n . . . r n is the element in K defined by 

wt(0) = val(wt(ri), . . . , wt(r n )) . 

We say that A4 is a weighted pushdown automaton (WPDA) if @{w) is finite for every t«eS* 
or if if is complete. In this case we define the quantitative behavior of Ai to be the series 
\\M\\ G if((S*}} given for every 10 G S* by 

(\\M\\,w)= Yl wt W • 
6>ee(to) 

The class of quantitative behaviors of all WPDA over E and K is denoted by PDA(S,if). 
Moreover, we let uPDA(S,if) comprise all series ||A^|| where A4 is an unambiguous WPDA. 
We say that two WPDA are equivalent, if they have the same quantitative behavior. 

Clearly, any PDA A4 can be transformed into a WPDA over the Boolean semiring B by adding 
the weight assignment wt : T — >■ B such that wt(r) = 1 for each r G T. Then for each ineE* 
we have w G L(M) if and only if (||.A4||, w) = 1, i.e., ||.A4|| = 1l(A4)- Consequently, a language 
L is recognized by a PDA if and only if Ij, G PDA(S,B). This shows that WPDA form a 
generalization of PDA. 

We say that a PDA A4 = (Q, T, qo, 70, F, T, wt) with weights is proper if (q, e, 7, p, it) G T 
implies \ir\ > 2 (cf. [20j p. 172]), i.e., M. extends its pushdown in each e-transition. Then 
obviously the set @(w) is finite for every weS', 

Observation 4.2. Each proper PDA with weights is a WPDA. 
A WPDA M. = (Q, T, qo, 70, F, T, wt) is state normalized if 

• there is no transition in T with go as target state, 

• F is a singleton, say, F = {(?/}, and 

• there is no transition in T with qj as source state. 

Lemma 4.3. For every (unambiguous) WPDA there is an equivalent state normalized (unam- 
biguous) WPDA. 

Proof. Let M = (Q, V, q , 70, F, T, wt). We construct the PDA with weights M' = 
(Q',T',q' ,%,{q f },T',wt') with 
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• Q' = Q U {q' , q f } with Q n {q' , q f } = 0, 

. r' = ru{ 7o }, 

• T' = TU {r in } U {r p | p G F}, r in = (g , e, 7 , q , 7 7 ) and r p = (p, e, 7 , g/, e) and 

• wt' |t = wt and wt'(Ti n ) = wt(T p ) = 1, for each p G F. 

Let = T1T2 ... r n be a computation of M on w and let p be the target state of r n . Then 
6' = t- U \Ti T2 ... T n r p is a computation of .M' on w and wt'(6>') = wt(6>). Vice versa, every 
computation of M! on u> has the form T\ n T\T2 ■ ■ ■ r n r p for some p £ F. Then -77x2 ... r n is a 
computation of .A4 on w. 

Moreover, A4' is a WPDA. Thus we have \\A4\\ = |A4'|. Clearly, A4 is unambiguous if and only 
if M! is unambiguous. □ 

Next we show that WPDA with just one state are as powerful as arbitrary WPA using the 
classical triple construction (cf. e.g. [19, Lecture 25]). 

Lemma 4.4. For every (unambiguous) WPDA there is an equivalent (unambiguous) WPDA 
with just one state. 

Proof. Let A4 be a WPDA. By Lemma 14.31 we can assume that Ai is state normalized and 
has the form (Q, T, go, 70, {qf}, T, wt). Then we construct the PDA with weights M! = 
({*}, r', *, (qo, 70, qf), {*}, T", wt') and T' = Q x T x Q as follows. For each transition 

7, Po, 7i • • -Ik) G T 

and every pi, ■ ■ ■ ,Pk £ Q, the transition 

(q,7,Pk),*, (pO)7i»Pi)(Pi) 72,^2) • • • (PA-l,7A)Pfc)) 

is in T". For = this reads: if (g, x, 7,po, e) G ^, then (*, x, (g, 7,po), =*S e) G T'. 
Moreover, 

wt'((*,x, (g,7,p fc ),*, (po,7i)Pi)(Pi) 72, P2) • • • (Pfe-i)7fe)Pfc))) = wt((g,x,7,p ,7l • • -7fc))) • 

For every computation 6 of Ai we construct a computation 95(6) of .M' as follows. Let 
G &m{ w ) an d t = (g, x,7,p, 71 . . . 7fc) be a transition which occurs in 6. Then 9 can be 
decomposed into 

01 T 6» 2 

(go, to, 70) I- (<?, 7A 1 ) ^ (p> «> 71 ■ ■ ■ 7fcJ«) l~ (?/,£, e) • 

Let 77, u, and p' be the, resp., shortest prefix of 62, shortest prefix of u, and uniquely determined 
state such that 

v 

(p,u,7i ...7jfc) h (p ,e,e) . 

Put po = p. Then, by Observation 14. 1\ for i = 1, . . . , k we can successively find a shortest 
word d, £ S*, a uniquely determined state pj G Q, and a shortest computation r/j such that 
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(pi-i,Vi,ji) h (pi,s,e) and v = v\ . . .Vk, Pk = p', and 77 = 771...%. Then we replace the 
occurrence r in # = #it# 2 by 

¥>(r) = (q,j,Pk),*, 0,7i)Pi)(Pi,72,P2) • • • (Pfc-l, TfcjP')) • 

We extend ip to computations by letting 

(/?(n . . . r n ) = yj(n) . . . <^(r n ) . 

In particular, if : Q_m{w) — > ©^/(ui) is bijective. Thus, since Al is a WPDA, also Af is a 
WPDA. Since wt(r) = wt(p(r)), we have wt(0) = wt(y>(0)). Hence, ||At|| = lACf. 

It is clear that M is unambiguous if and only if Af' is unambiguous. □ 
Lemma 4.5. Let s a , s 2 G PDA(E, K). T/ien s a + s 2 6 PDA(E, if). 

Proof. Let Ala = (Qi,ri,<3<Q,i,7o,i,i<i,Ti,wti) and Af 2 = (Q2, r 2 , <?q,2, 70,2, P2, P2, wt 2 ) be 
state normalized WPDA such that si = and s 2 = ||A( 2 ||. Without loss of generality we 

can assume that 

• Qo,i = Qo,2 and Qi H Q 2 = {go,i}; henceforth we will denote this initial state by qo, and 

• 7q 1 = 70,2; henceforth we will denote this initial pushdown symbol by 70. 

Now we construct the WPDA M = (Q,F,q ,jo,F,T, wt) with Q = Q 1 U Q 2 , T = T 1 U T 2 , 
F = Fi U P 2 , and T = T\ U T 2 . Moreover, we let wt \t ± = wti and wt |t 2 = wt 2 . Then 
= |A*i| + |<M 2 |. □ 



Finally, we mention that in [9] pushdown games with quantitative objectives were investigated. 
Such games are formalized on the basis of paths through pushdown systems where the latter 
are particular pushdown automata with weights: the input alphabet S is a singleton and no e- 
transition occurs. Moreover, as weight structure, pushdown systems employ the set of integers 
with mean-payoff. Roughly, the mean-payoff of a computation is the average of its transition 
weights (taking the limes superior of the averages of finite prefixes on infinite computations). 
Then in [9] game-theoretic problems on the set of all paths for which the mean-payoff is above 
a given threshold are investigated. 



5 Equivalence of WCFG and WPDA 

A classical result says that a language L is context-free if, and only if L is accepted by a 
pushdown automaton. This was extended to algebraic series and weighted pushdown automata 
with weights taken in semirings in [20^ Cor. 14.16]. The goal of this section is to prove the 
following generalization to arbitrary unital valuation monoids. 

Theorem 5.1. For every alphabet E and unital valuation monoid K we have PDA(X,Zf) = 
CF(S,K) and uPDA(S, K) = uCF(S,K). 

We will prove this theorem by showing that WCFG in head normal form and WPDA with one 
state are equivalent models (cf. e.g. [19, Lecture 25]). 

Let M. = ({*}, T, *, 70, {*}, T, wtx) be a WPDA over E and K with one state and Q = 
(N, E, Z, P, wtg) be a WCFG over K in head normal form. We say that M. and Q are related 
if 
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• 70 = Z, 

• t = (*, x, A, *, #i£ 2 • • • B n ) £ T iff p = (A —■ xB x B 2 ...B n ) is in P. 

• wt_A/j(r) = wtg(p) if r and p correspond to each other as above. 

Lemma 5.2. Let M be a WPDA with one state and Q be a WCFG in head normal form. 
If M. and Q are related, then \M\ = \Q\. Moreover, M. is unambiguous if and only if Q is 
unambiguous. 

Proof. For every w 6 £*, the set Q{w) of computations on w corresponds bijectively to the 
set D{w) of derivations of ui, and this correspondence preserves their weights. This implies 

(\\M\\,w) = (\\g\\,w). □ 

Proof of Theorem \5.1\ If s £ PDA(E, K), then by Lemma 14.41 there is a WPDA Ai with one 
state such that \M\ = s. Next we construct the WCFG Q which is related to M. By Lemma 
15.21 we obtain that s £ CF(E,_RT). Correspondingly, the converse follows from Lemmas 13.31 and 

EZ □ 



6 Theorem of Chomsky-Schiitzenberger 

In this section let K again be a unital valuation monoid. The goal of this section will be to 
prove a quantitative version of the Chomsky-Schiitzenberger theorem. 

Let Y be an alphabet. Then we let Y = {y \ y £ Y}. The Dyck-language over Y, denoted by 
Dy , is the language which is generated by the CFG Qy = (N, Y U Y, Z, P) with iV = {Z} and 
the rules Z — > yZy, Z — > ZZ, and Z e. 

Next we introduce the concept of alphabetic morphism. A series s € K((T,*)) is called a monome 
if supp(s) is empty or a singleton. If supp(s) = {w}, then we also write s = (s,w).w . We let 
K(E U {e}) denote the set of all monomes with support in S U {e}. 

Let A be an alphabet and h : A — > K{Y> U {e}} be a mapping. The alphabetic morphism 
induced by h is the mapping h' : A* — > K{{T,*}} such that for every n > 0, 6±, . . . , S n 6 A with 
h{5i) = ai.yi we have 

h'(8i ...5 n )= val(ai, . . . , a n ).yi ...y n . 

Note that h'(v) is a monome for every v € A*, and h'(e) = I.e. If L C A* such that the family 
(h'(v) | v 6 L) is locally finite or if K is complete, we let = X^eL ^'( 1 0- I n t ne sequel we 

identify h! and /i. 

Our main result will be: 

Theorem 6.1. Let K be a unital valuation monoid and s € K{{T,*)) be a series. Then the 
following three statements are equivalent. 

1. s e CF(Z,K). 

2. There are an alphabet Y , a recognizable language R over Y UY , and an alphabetic mor- 
phism h : Y U F K (E U {e}) such that s = h(D Y CiR) . 
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3. There are an alphabet A, an unambiguous CFG Q over A, and an alphabetic morphism 
h : A -»• K(T, U {e}) swc/i ttat s = h(L(Q)). 

Moreover, if K is complete and completely idempotent, then 1-3 are also equivalent to: 

4- There are an alphabet A, a context-free language L over A, and an alphabetic morphism 
h : A ->• K(T, U {e}) such that s = h(L). 

First we investigate alphabetic morphisms. 

Lemma 6.2. Let s S CF(E, K). Then there are an alphabet A, an unambiguous CFG Q over 
A, and an alphabetic morphism h : A — > K(E U {e}) such that s = h{L(Q)). 

Proof. By Lemma 13.31 we can assume that s = \H\ for some WCFG % = (N, S, Z, P, wt) in 
head normal form. 

We let A = P, and we construct the CFG Q = (N, P, Z, P') and the mapping h : P — s> 
K(Y, U {e}) such that, if p = (A — > xB\ . . . B^) is in P, then A — > pB\ . . . is in P' and we 
define h(p) = wt(p).x. Obviously, Q is unambiguous. 

By definition of h, we have that h(d) = val(wt( / oi), . . . , wt(p n )).w for every to £ E* and 
d = p\ . . . p n £ Du(w). Hence wt(cf) = (h(d),w). 

It is clear that L{Q) = LLgs* D%(w) and Dy^(w) n D%(w') = for every w ^ w' . Hence, 
{d 6 L(Q) | (h(d),w) ^ 0} C Dy^(w), which is finite by definition of WCFG in case K is not 
complete. Thus, (h(d) \ d € L(Q)) is locally finite if K is not complete. 

Then for every w £ S* we have 

{\H\,w) = EdeD-uW wt ( d ) = T.deD n (w)( h (d),w) 

=* E d eL(g)(Kd),w) = (£ deL(g) ^), w) = (h(L(G)),w) 

where the equation * holds, because for every d G L{Q) \ D^(w) we have (h(d),w) = 0. Thus 
s = h{L{g)). □ 

Example 6.3. We apply the construction in the proof of Lemma [6.2l to the WCFG of Example 
13.41 and assume that it is given as the following WCFG H in head normal form: 

pi : E 4 E®E p 2 : E ™ EQE 
p 3 : E \ (E<2) Pi ■ E -4 x . 

with the following three additional productions: 

P5 ■ © -4 + , p 6 : -4 * , p 7 : 4 ) . 

In Ti, the terminal string w = x*x + x*x has the derivation d = p\d! p^d! with 

d' = P2P4P6PA ■ 

The application of the construction yields the CFG Q: 

E -» p 1 E@E E -» p 2 EQE 
E ^ p 3 E0 E -» p 4 

-> P5 ->• P6 
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and the alphabetic morphism h: 



Kpi) 
h( P3 ) 

Hps) 



n.e 



1.+ 



h(p 2 ) = m.e 
h(p/C} = 1.x 
h(p 6 ) = 1.* 



Kpi) 



Then, using the abbreviation d! 



P2P4P6P4 and w = x*x + x*xas above, we have 



Kpid', 



psd') 




n+2-m 

3 



. W 



and hence wt(u>) = (h(d),w). 

In the next lemma we show the converse of Lemma 16.21 

Lemma 6.4. Let L be a context-free language over A and h : A — > K(E U {e}) an alphabetic 
morphism such that (h(v) \ v G L) is locally finite in case K is not complete. If L can be 
generated by some unambiguous CFG or if K is complete and completely idempotent, then 



Proof. Let M = (Q,F, q ,~/o, F,T) be a PDA over A with L(M) = L. Moreover, by Theorem 
15.11 if L = L(Q) for some unambiguous CFG Q, then we can assume that A4 is unambiguous. 
Let 5 G A be an arbitrary, but fixed element. 

The following construction employs the same technique as in [15} Lemma 5.7] of coding the 
preimage of h into the state set; thereby non-injectivity of h is handled appropriately. We 
construct the PDA over S with weights M' = (Q' , T, q' , 70, F', T', wt) where Q' = {q' } UQx 
(A U {e}) for some q' ^ Q, F' = F x {5}, and T' and wt are defined as follows. 

• For every x G A U {e}, the rule r = (q' , e, 70, (qo, x), 70) is in T' and wt(-r) = 1. 

• Let r = (q, x, j,p, it) G T and x' G A U {e}. 

— If x G A and h(x) = a.y, then r' = ((q, x), y, 7, (p, x'), tt) G T' and wt(r') = a. 

— If x = e, then r' = (((?, e), e, 7, (p, x'), ir) G T' and wt(r') = 1. 

Let v = 5% . . . S n G A* with n > and 5i G A. Let h(5i) = ai.yi for every 1 < i < n. Thus 
h(v) = val(oi, . . . ,a n ).yi . . . y n . 

Let 6 = t\ . . . r m be a go-computation in ©_^(t>); note that m > max{n, 1} because at least 70 
has to be popped. Let Xi be the second component of Tj, so, Xi G A U {e}. 

Then we construct the ^-computation 9' = Tqt{ ... in ®m'{Vi ■ ■ ■ Un) as follows: 

• T o = (<?o> e >7o, (9o,^i),7o)- 

• If 1 < i < m and n = (q,Xi,j,p,n), then t[ = ((q, x^, y',j, (p, x i+ i), 7r) where y' = y if 
Xi £ A and = a.y, and y' = e if x,- t = e, and x m+ i = 5. 



h(L) G CF(£,fO. 
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Note that if X{ E A and h{xi) = a.y, then wt(r J / ) = a, and if Xi = e, then wt(r 4 ') = 1 for each 
1 < i < m, by definition of wt. Consequently, if w € X* and (h(v),w) ^ 0, then w = y\ . . . y n 
and 

(h(v),w) = val(oi, . . . ,On) = val(wt(ro),wt(r(), . . . , wt(r'J) = wt(<9'). 

Conversely, for every g -computation 9' = Tqt[ . . . T' m in @M' (vi ■ ■ ■ Vn) there is a uniquely 
determined go-computation 9 = t\ . . . r m in Gjk (v) such that 9' is the computation constructed 
above. It follows that M 1 is a WPDA. 

In particular, if (h(v),w) ^ 0, then wt(9' 1 ) = (h(v),w) = wt(8' 2 ) for every B'^O^ G Qm{ v )- 
So, for every w € X* we obtain 

(/i(L(.M)),«;) = (Z v eL( M ) h (v),w) 

= E i>GL(A4): (h(v),w) 

= (\M%w) 

where the *-marked equality holds because (1) K is complete and completely idempotent or 
(2) M is unambiguous. Thus \M'\ = h(L(A4)) and the result follows from Theorem 15.11 □ 

We include the argument for the following simple observation for the sake of completeness. 
Observation 6.5. 

1. There is an unambiguous CFG Q such that L{Q) = Dy. 

2. Let Q be an unambiguous CFG over S and R C X* is a regular language. Then there is 
an unambiguous CFG Q' with L{Q') = L(Q) n R. 

Proof. 1. We consider the CFG Q' Y = (N,YUY, Z, P) with N = {Z, A} and the rules Z -> AZ, 
Z — > e, and A — > yZy. Clearly, L{Q' Y ) = Dy, and Q' Y is unambiguous (cf. [101 Prop.l, p. 145]). 

2. Using [2, Lm.4.1] we can construct the CFG %\ such that L(Hi) = L{Q) \ {e} and "Hi does 
not contain a production of the form A — > e. By inspection of the construction we obtain that 
also Hi is unambiguous. 

Now let A be a deterministic finite-state string automaton such that L(A) = R. Then we can 
apply the construction of [2, Thm.8.1] to Hi and A and obtain an unambiguous CFG H2 with 
= L(Hi) nR. Let Z be the initial nonterminal of Hi- Finally, from H2 we can construct 
the unambiguous CFG Q' as follows: if e 6 L(Q) Pi R, then we add the new initial nonterminal 
Z' and the productions Z' — > Z and Z' — > e to H2, otherwise let Q' = 7i2- It is clear that Q' is 
unambiguous and L{Q') = L{Q) PI R. □ 

As consequence of Lemmas 16.21 and 16.41 and of the result of Chomsky-Schutzenberger for 
context-free languages we can now derive the result of Chomsky-Schutzenberger for quanti- 
tative context-free languages. 
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Proof of Theorem \6.1\ 1 44> 3: Immediate by Lemmas 16.21 and 16.41 

2 =^ 3: by Observation 16.51 

3 =^ 2: By the classical result of Chomsky-Schiitzenberger (cf. e.g. |19[ Thm.Gl]) there are an 
alphabet Y, a recognizable language R over Y L)Y, and an alphabetic morphism g :Y UY 

A U {e} such that L(Q) = g(Dy n R). By analysis of the construction, we have that the set 
is in a one-to-one correspondence with Dg(v), for every v G L(Q). Since Q is 
unambiguous, we have that \g~ x (y) fl Dy fl R\ = 1. 

Next we prove that (h o g(v') j v' G Dy PiR) is locally finite in case K is not complete. Since 
h(L(Q)) is defined, the set I w = {v G L(Q) \ (h(v),w) ^ 0} is finite for every w G £*. Since 
fl Dy n -R is a singleton for every v G L(Q), the set {«' € Dy C\R \ (h(g(v')),w) ^ 0} is 
finite for every w E S*. Hence (h o g(v') \ v' G Dy PiR) is locally finite. 

Thus h o g : Y UY —■ K{Y* U {e}) is an alphabetic morphism, (h o g)(Dy D R) is well defined, 
and s = (ho g)(Dy n R). 

3 => 4: trivial. 

4 => 1: by Lemma WM □ 



7 Context-Free Step Functions 

An important result in the theory of rational formal power series states that recognizable series 
over a semiring in which both operations are restricted to be locally finite, are recognizable 
step functions |14t Thm.ll]. Here we investigate this concept for context-free step functions 
over unital valuation monoids K. 

If L C S* and a G K, we let a ■ 1l G K{{T,*)) be the series satisfying (a • lz,,iu) = a if w 6 L, 
and (cl-1l,w) =0 otherwise. 

Let s G if ((£*}}. We say that s is a context-free step function if s = Ya=i a * ' f° r some 
n G N, oi, . . . ,a n G iC, and context-free languages L%, . . . ,L n C S*. The languages Lj are 
called step languages. Moreover, a context-free step function is a recognizable step function if 
each Lj is recognizable. 

As is well known, a recognizable step function over any semiring is a recognizable series [16} 
Ch.VI, Sec. 7]. This even holds for strong bimonoids with the same proof |14l Lemma 8], and 
could be extended to unital valuation monoids. In contrast, this implication fails for context- 
free languages and quantitative context-free languages. 

Observation 7.1. Let L be an inherently ambiguous context-free language. Then 1^ 
CF(S,N). 

Proof. Assume that t L G CF(S,N). Then let Q be a WCFG such that 1 L = \\g\\. Then, 
for every word w G L, we have that \Dg(w)\ = 1, because otherwise the weights of different 
derivations of w would sum up to a value greater than 1 . But then the CFG which is underlying 
Q is an unambiguous CFG for L, which contradicts to our assumption on L. □ 

However under suitable restrictions we obtain the following positive result. 

Lemma 7.2. Let L be a context-free language over S and a G K . If L can be generated by some 
unambiguous CFG or if K is complete and completely idempotent, then a ■ tz G CF(E,if). 
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Proof. We choose a new symbol ff G" S and define the context-free language L' = | iu € L} 
over S' = EU {#}• Moreover, we define the alphabetic morphism iT(£ U {e}) by 

= a.e and /i(cr) = l.a for every <tEE, 

Clearly, if L can be generated by some unambiguous CFG, then this also holds for V . Moreover, 
(h(v) | v G L') is locally finite in case K is not complete. It follows that a ■ 1l = h(L'). By 
LemmaE3]we obtain that h(L') G CF(H,K). □ 

We call a context-free step function a context-free step function with unambiguous step lan- 
guages if each of its step languages can be generated by an unambiguous CFG. 

Corollary 7.3. Let s G K ((£*)) be a context-free step function. Let s have unambiguous step 
languages or let K be complete and completely idempotent. Then s G CF(S,if). 

Proof. The statement follows from Lemmas 17.21 and 14.51 and Theorem 15.11 □ 

A context-free step function s = Y17=i °* ' * s caue d strong if the family (Lj | 1 < i < n) 
forms a partition of £*, i.e., L, L n Lj = for every i ^ j, and S* = IJILi A- 

Observation 7.4. Lei s G K{(E*)) be a power series. The following statements are equivalent: 

1. s is a strong context-free step function. 

2. im(s) is finite and s~ 1 (a) is a context-free language for every a G im(s). 

Due to the closure properties of the class of recognizable languages, we can transform every 
recognizable step function over E* into an equivalent one for which the collection of its step 
languages partitions X*. This is different for context-free step functions. 

Observation 7.5. There are context-free series which are context-free step functions but not 
strong context-free step functions. 

Proof. For this consider, e.g., the context-free step function s = 1-1^ +2-~&l 2 over the semiring 
of natural numbers with L\ = {a n b n c k \ n, k G N} and L2 = {a k b n c n \ n, k G N}. (Recall from 
Example 12.11 that we can view any semiring as a particular unital valuation monoid.). Since 
L\ and L2 can be generated by unambiguous CFG, we obtain from Corollary 17.31 that s is a 
context-free series. But 3 G im(s) and s _1 (3) = {a n b n c n \ n G N} which is not context-free. □ 

In the rest of this section we will prove a converse of Corollary 17.31 We say that K is locally 
finite, if whenever F C K is a finite subset, then the set val(.F*) comprising the valuations of 
all finite sequences of elements of F is finite. 

Example 7.6. 1. Consider a calculator and let K be its (finite) set of nonnegative storable 
numbers. Then (K, sup, avg, 0) is a finite valuation monoid. If we apply the procedure of 
Example 12.1( 1). we obtain a finite completely idempotent unital valuation monoid which is not 
a unital monoid-magma. 

2. Consider the unital valuation monoid K = (R U {—00, 00}, sup, avg', —00, 00) where avg' is 
avg followed by truncation to a number having a prescribed bounded decimal expansion. Then 
K is infinite, completely indempotent, and locally finite. This describes a situation where 
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we may have exact input data and exact avg computation, but an output only of sufficient 
bounded precision. 

3. A strong bimonoid (if, +, •, 0, 1) is called multiplicatively locally finite, if whenever F C if is 
a finite subset, then the submonoid (F) of (if, •, 1) generated by F is finite, cf. [15] for examples. 
Then a strong bimonoid if is multiplicatively locally finite if and only if its associated valuation 
monoid (cf. Example 12.1( 4)) is locally finite. 

Now we show: 

Theorem 7.7. Let if be an additively idempotent, locally finite unital valuation monoid. As- 
sume that if is completely idempotent in case that if is complete. Then each series s 6 
CF(E,if) is a context-free step function. 

Proof. Due to Theorem 15.11 there is a WPDA M. = (Q, T, qo, 70, F, T, wt) over £ and if such 
that ||.M|| = s. Clearly, wt(T) is a finite subset of if. Let Y = val(wt(T)*). Then Y is finite. 
Also note that wt(0) 6 Y for every computation 6 of A4. 

Let w € £*. Then 

(|M|M= £ wt(0) = ]T 53 wt(0) =* J> • 

eee(«i) a& eee(w) aeY 

wt(6)=a 

where L a = {v € S* | there is a ^ € 0(u) with wt(0) = a}. The equation marked by * holds 
because K is additively idempotent, respectively, completely idempotent in case K is complete. 
It remains to prove that L a is context-free for every a € Y. 

We construct the PDA M a = (Q', T, q' , 70, F' , T') where Q' = Q X Y, q' Q = (q ,l), and 
F' = F x {a}. Moreover, we let 

T ' = {{(Q,y),x,7, {P,y'),n) I r = (<?,x,7,p,7r) G T, there are 
u;, u € S*, |U S r*, and a computation of M. such that 

(<?o,w 5 7o) I- {q,xv,in),y = wt(6>), and j/' = wt(6»r)} . 

Then ^Q-computations of A^a correspond to go- com P u f a fi° ns ^ of A4 with wt(0) = a, and 
conversely. It follows that L(Ai a ) = hence L a is a context-free language. □ 

Note that in the previous theorem, in general s is not a strong context-free step function, 
because L a and L a i need not be disjoint. 

A lattice is called complete if any subset has a supremum and infimum. Trivially, every complete 
bounded lattice is a completely idempotent and multiplicatively locally finite strong bimonoid, 
hence a locally finite unital valuation monoid. So, as a consequence of Corollary 17.31 and 
Theorem 17.71 we obtain immediately the following. 

Corollary 7.8. Let K be a complete bounded lattice and s € if ((£*)). Then s £ CF(S,if) if 
and only if s is a context-free step function. 
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8 Conclusion and Open problems 



We could show that a fundamental result of formal language theory, the Chomsky-Schiitzenberger 
theorem, holds not only in semiring- weighted settings, but even for much more general com- 
putation models, the unital valuation monoids, which include, e.g., computations of averages 
of real numbers. We can represent the quantitative languages by weighted context-free gram- 
mars and by weighted pushdown automata; both formalisms were shown to be expressively 
equivalent. Finally, we considered context-free step functions. 

In |14l Thm.ll] it was proved that every recognizable series over any additively locally finite 
and multiplicatively locally finite strong bimonoid is a recognizable step function. In the light 
of this result, we wonder whether it is possible to extend our Theorem 17. 71 to additively locally 
finite strong bimonoids (while keeping the restriction on the multiplication operation). 
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